Long-range correlated stationary Markovian processes 



Fabrizio Lillo*, Salvatore Micciche*' 1 ' and Rosario N. Mantegna *' t 
* Istituto Nazionale per la Fisica della Materia, Unita di Palermo Viale delle Scienze, 1-90128 Palermo, Italy 
Dipartimento di Fisica e Tecnologie Relative, Universita di Palermo, Viale delle Scienze, 1-90128 Palermo, Italy 

We introduce a new class of stochastic processes which are stationary, Markovian and characterized 
by an infinite range of time-scales. By transforming the Fokker-Planck equation of the process into a 
Schrodinger equation with an appropriate quantum potential we determine the asymptotic behavior 
of the autocorrelation function of the process in an analytical way. We find the conditions needed 
to observe a stationary long-range correlated Markovian process. In the presence of long-range 
correlation, for selected values of the control parameters, the process has a 1/ /-like spectral density 
for low frequency values. 
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Since the classical works on Brownian motion ||] 
a great variety of physical systems has been modeled in 
terms of stochastic processes ||. Stochastic processes 
can be differently classified depending on the properties 
of their conditional probability densities. Among random 
processes, Markov processes play a central role in the 
modeling of natural phenomena. A process x(t) is said 
to be a Markov process if the conditional probability den- 
sity P(x n+ i,t n+ i\x n ,t n ; . . . ;xi,ti) depends only on the 
last value x n at t n and not on the previous values x n —\ at 
t n _i, x n _2 at i„_2, etc. The transition probability of any 
Markov process fulfills the Chapman-Kolmogorov equa- 
tion H . It is worth noting that a Markov process is fully 
determined by the knowledge of the probability density 
function (pdf) W(x,t) of the process and the transition 
probability P(x n +i,t n +i\x n , t n ). Such level of simplicity 
is rather unique among stochastic processes. In fact, a 
non-Markovian process is characterized by an infinite hi- 
erarchy of transition probabilities. When the Markovian 
process is continuous both in space and time, the time 
evolution of the pdf is described by a Fokker-Planck (FP) 
equation. 

Another classification of stochastic processes considers 
the nature of correlation of the random variable. Under 
this classification, random variables are divided in short- 
range and long-range correlated variables. Short-range 
correlated variables are characterized by a finite mean of 
time-scales of the process whereas a similar mean time- 
scale does not exist for long-range correlated variables. 
An equivalent definition can be given by considering the 
finiteness or infiniteness of the integral of the autocor- 
relation function of the random process j|, |j| q{. Long- 
range correlated processes x(t) are usually characterized 
by a 1/ /-like spectral density and 1 If noise has been ob- 
served in several physical systems j?J || . In the presence 
of long-range correlation, the time integral s(t) of the 
process x(t) is a superdiffusive stochastic process show- 
ing (As 2 (i)) ~ Dj V with 7 > 1 and D 1 is a constant. 
Superdiffusive stochastic processes have been observed in 
several physical systems. A classical example is Richard- 
son's observation that two particles moving in a turbulent 
fluid which at time t = are originally placed very close 
the one with the other have a relative separation £ at 



time t that follows the relation < l 2 {t) >cx t 3 ||. More 
recent examples include anomalous kinetic in chaotic dy- 
namics due to flights and trapping [flOfl , dynamics of ag- 
gregate of amphiphilic molecules [[flf and dynamics of 
a tracer in a two-dimensional rotating flow Sev- 
eral non-Markovian [TJ, |l5| or non-stationary [jioj. [Tij| 
models of long-range correlated and anomalous diffusing 
processes have been developed. 

Stationary Markovian processes are usually short- 
range correlated. However, the formal definition of a 
Markovian process does not imply that all stationary 
Markovian processes must be short-range correlated. In 
this Letter, we analytically show that there exists a class 
of stationary Markovian processes with an asymptotically 
power-law decaying autocorrelation function. For a finite 
range of the control parameters the process is long-range 
correlated. To this end, let us consider a continuous 
Markovian stochastic process x(t) whose pdf W(x,t) is 
described by the FP equation with constant diffusion co- 
efficient d t W = -d x (D^(x)W) + Dd 2 x W. For the sake 
of simplicity, in this study we set D = 1. The eigen- 
value spectrum of the FP equation describing a station- 
ary process consists of a discrete part Ao = 0, Ai, A p 
and a continuous part ]A C , +oo[ (A c X p ) associated with 
eigenf unctions tp\. The stationary pdf is W(x) = ifQ. 
The FP equation with constant diffusion coefficient can 
be transformed into a Schrodinger equation ]18| with a 
quantum potential V s (x) = (Z>W (x)) 2 /4 + dJJW (x)/2. 
The eigenvalue spectrum of the Schrodinger equation is 
equal to the eigenvalue spectrum of the FP equation. The 
relation between the cigenfunctions of the FP equation 
and the eigenfunctions ip\ of the Schrodinger equation is 
(fx = ip\ipo- For a stationary process the 2-point proba- 
bility density function W-z{x, t;x' , t+r) can be expressed 
in terms of the eigenfunctions of the Schrodinger equa- 
tion. Specifically, one can write 



W 2 (x,t;x',t + T) = tpo(x) ip {x') x 



(1) 



Mx)i>x(x')e- XT + ol\^ x {x)^ x {x') 



, A=Ai 



+ OC 



,-At 



Ac 



Eq. ([!]) extends the analogous expression valid for a FP 
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equation with only discrete spectrum pj| to the case in 
which there also exists a continuous part of the spec- 
trum. In order to evaluate the autocorrelation function 
R{r) = {(x{t+r)x(t))-(x(t)) 2 )/{(x 2 (t))-(x(t)) 2 )ofthe 
stochastic variable x(t), we make use of the expression 



A P p + OO 

(x(t + r)x(t))=J2 C 2 x e-^+ C 2 e-^d\, (2) 

A=Ai 

where C\ = J dx x(p\(x). The analogous of Eq. (j^) 
valid for a FP equation with a discrete spectrum is given 
in Ref . (l9| . Eq. (^) follows from Eq. and from the 
definition 



( X (t + T)x(t)) 



dx dxx xW2(x,t;x ,t + t). (3) 



Eq. (|2|) holds true under the assumption that the inte- 
grations in J dx' J dx and J dX can be interchanged. 

The asymptotic temporal dependence of the autocor- 
relation function can have a different behavior depending 
on the properties of the eigenvalue spectrum. Specifically, 
we distinguish three different cases: (a) when the spec- 
trum contains the eigenvalue Ao = and at least one dis- 
crete eigenvalue Ai > 0, then R(t) decays as exp(— Air). 
As an example we mention the Ornstein-Uhlenbeck pro- 
cess gj and the stochastic process associated to the in- 
finite square well quantum potential discussed in Ref. 
p8[ ; (b) when the spectrum contains only one bound 
state corresponding to Ao = and A c > the spectrum 
has a gap between the eigenvalue Ao and its continuous 
part. We do not know the general form of the asymptotic 
behavior of R(t) for this class of potentials. However, 
for some specific cases we have found that R(t) decays 
as e~ AcT /r 3 / 2 . One example is the V-shaped potential 
of the FP equation discussed in Ref. fl8| ; (c) when the 
spectrum contains only one bound state corresponding to 
Ao = and A c = there is no gap in the spectrum and 
a non-exponential asymptotic autocorrelation function is 
in general observed. Eq. (|J) shows that the quantity 
(x(t + r)x(t)) is the weighted sum of an infinite number 
of exponential functions of time, each characterized by a 
time-scale A -1 . The largest scale of the process is deter- 
mined by the smallest non- vanishing eigenvalue. In case 

(a) the maximal time-scale of the process is AJ" . In case 

(b) A^ 1 is finite and it is the upper bound of the time- 
scales of the stochastic process. In case (c) A" 1 diverges 
and the interval of time-scales of the process is infinite. 

Here we investigate Markovian processes whose maxi- 
mal time-scale is diverging. This is first done by studying 
the stochastic process associated with a quantum poten- 
tial Vs given by 



V s 



-V 
V l /x 2 



if 
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\x\ L, 
\x\ > L, 



(4) 



and V\ can be chosen in such a way that the spectrum 
contains one single discrete eigenvalue Ao = and a con- 
tinuous part for A > 0, as in case (c) discussed above. As 
a result, the parameters L, Vq and V\ are not indepen- 
dent. In fact, the continuity of d x ipo in x — L provides a 
relation between them. The drift coefficient of the corre- 
sponding FP equation is 

-2/V^tan(VVoa;) if M < L, 

D^(x) = { (5) 

(1 - VTTTVi)/x if |z| > L. 

The associated FP equation describes the dynamics of an 
overdamped particle moving in a potential that increases 
logarithmically in x. For |x| Sj L, the eigenfunction of the 
ground state is ipo — B cos(v / Vo x) whereas for |x| > L 
it decays according to tpQ = Ax^^ 1+AVl ^ 2 . The con- 
stants A and B are set by imposing that V'o is normal- 
ized and continuous in x — L. It is worth noting that 
for | a; | > L the stationary pdf W(x) of the stochastic 
process is a power-law function decaying as \x\~ a with 
a = \f\ + 4 Vi — 1. The normalizability of the eigen- 
function of the ground state is ensured if a > 1. In 
the present study we consider stochastic processes with 
finite variance which implies a > 3. Due to parity ar- 
guments, only the odd eigenfunctions ip^ dd ^ of the con- 
tinuous spectrum give a non-vanishing contribution to 
C\. For | re j > L the eigenfunction i/;^^ is a linear com- 
bination of Bessel functions tp 1 ^" 1 ^ = a\ ^/xJ ll {\f\x) + 
bw/xY^i^/Xx) where v = (a + l)/2. For |x| ^ L wc 
find V^ od! ^ = d\ sin(v / Vo + Ax). The coefficients ax, b\ 
and d\ are fixed by imposing that tp^ dd ^ and its first 

derivative are continuous in x = L and that ip^ dd ^ are 
orthonormalized with a 5-function of the energy. By us- 
ing these eigenfunctions we obtain an exact expression for 
C\. The further integration required in Eq. (J2J) to ob- 
tain (x(t + r) x(t)} cannot be performed analytically. By 
using Watson's lemma |2Q] and by considering that the 
first term of the Taylor expansion of C\ is proportional 
to A'" -5 -'/ 2 for small values of A, we find that the asymp- 
totic behavior of (x(t + r) x(t)) valid for large values of 
t is 



(x(t + T)x(t)} - Kt~ 



(6) 



where if is a constant that can be explicitely calculated 
in terms of the characteristic parameters of the process. 
The exponent (3 is related to the exponent a through 



/3 = (a-3)/2. 



(7) 



where L, Vb and V\ are positive constants. This is an 
exactly solvable even potential. The parameters L, Vq 



To the best of our knowledge this is the first example of 
a stochastic process which is stationary, Markovian and 
asymptotically power-law autocorrelated. 

The above result can also be obtained by considering a 
different approach based on the 2-point probability den- 
sity function Wi. In this case, the study can be made 
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more general than the previous exact case by considering 
any quantum potential that asymptotically decays as 



V s (x) 



a(a + 2) 1 



\x\ > x, 



(8) 



and which is characterized by an eigenvalue spectrum as 
described in case (c). A quantum potential having the 
above discussed properties has been introduced by two 
of us in Ref . |2lJ . The drift coefficient of the FP equa- 
tion asymptotically depends on x as D^(x) ~ —a/x. 
For |x| >> x the eigenfunctions for the class of poten- 
tials of Eq. (|) are the same as those of the potential of 
Eq. (|J). In general the integration required in Eq. (Q) 
cannot be performed analytically. However, the asymp- 
totic behavior of W% for large values of r can be ob- 
tained by considering the small energy behavior of the 
eigenfunctions ip\. In our calculations we distinguish 
three regions (i) |x| < x, (ii) x < \x\ < x\ and (hi) 
|x| > x\ where x\ oc A~2. The asymptotic behavior of 
W2 for large r depends on the values of x and x' and the 
function (x(t + r) x(t)) can be evaluated by splitting the 
double integrations required in Eq. (||) in eight contri- 
butions according to which regions x and x' belong to. 
The eight contributions can be divided into two groups 
of four. The first group in essentially controlled by the 
1 jx 2 region of the quantum potential whereas the second 
is controlled by the specific form of the potential valid 
for \x\ < x. By using the fact that, for small values of A, 
ip\ can be approximated as ip\(x) ~ a\ yfxJ v (\fkx) ~ 
(2(«+ 2 )/2r((a + 3)/2))" 1 A( Q + 1 )/ 4 x 1+a / 2 in region (ii) 
and tpx(x) ~ ir~ 1 / 2 A -1 / 4 cos{^/\x + (fix) in region (iii), 
with (fix a phase factor, we prove that W2 asymptotically 
behaves as t~( q+3 )/ 2 and the contributions to R(t) as- 
sociated to the four terms of W% decay asymptotically 
as t~@ with (3 = {a — 3)/2 when both |a;| and \x'\ are 
larger than x. We are able to prove this result for a > 4. 
This limitation for the a values is an artifact of the ap- 
proximations used to perform the integrals. In fact, in 
our calculations we have replaced the cosine terms with 
unity, thus obtaining an upper bound for the four in- 
tegrals. The validity of our conclusions for a > 3 is 
supported by the exact result obtained for the poten- 
tial of Eq. (ji|). The contributions to R(t) associated to 
the remaining four terms depend on the specific form of 
the potential in region (i). For the potential described 
by Eq. (Q) these contributions decay to zero faster than 
t~P. For a generic potential we do not have a general 
result. However, by considering that the contribution of 
the remaining four terms is additive, we conclude that 
R(t) decays to zero at least as t~$ . 

We have therefore shown that a class of Markovian sta- 
tionary processes with a power-law autocorrelation func- 
tion exists. This is possible because the upper bound for 
the time-scales of the process is determined by A^ 1 which 
is infinite for the considered processes. However, we wish 
to stress that the absence of an upper bound for the time- 
scale is a necessary but not sufficient condition in order to 
observe a power-law decaying autocorrelation function. 



In fact, let us consider a stochastic process associated 
with a quantum potential decaying as Vs(x) ~ Vix~^ 
and with an eigenvalue spectrum consisting of a single 
bound state with eigenvalue Ao = and an attached con- 
tinuum part, as in case (c). The eigenfunction of the 
ground state is normalizable only for [i ^ 2 and when 
< /i < 2 the asymptotic behavior of tfio is proportional 
to x M / 4 exp(— k a; 1 "^/ 2 ), where k — \/V[/(l — /i/2). In 
order to obtain the asymptotic behavior of the autocorre- 
lation function we have to preliminary evaluate the func- 
tion Cx- By using the semi-classical WKB method we es- 
timate the eigenfunctions ifix ■ The condition under which 
this method can be applied is x 1 ^/ 2 >> ^/V\, and 
is fulfilled for any < \x < 2. The WKB method gives 
two approximations of the eigenfunctions that hold in the 
regions x < xx and x > xx, where xx is here the turning 
point defined by V\x^ = A. These approximations can 
be used to obtain the asymptotic behavior of Cx valid for 
small values of A. Specifically, we obtain 



^2 (2 + ^rf^5;exp 



2 + ^7 A5+ 



,(9) 
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By applying the saddle point method to the integration 
of Eq. (Q), we find for the asymptotic behavior of the 
autocorrelation function the expression 



R(T) ~RocT~ 



-1H;/--1 



2u 

(2?7)5+7r 



exp 

2 + M 



r 2 +m 



(10) 



2// 



2/i 
2 - n 



2-tj 
2 + M 



where R^ is a constant. The asymptotic behavior of 
the autocorrelation function is therefore dominated by a 
stretched exponential function. This is observed in spite 
of the fact that the upper bound of time-scales is infinite 
as for the processes with \i = 2. This is due to the fact 
that, despite the presence of an infinite range of time- 
scales, the weight of the longest time-scales (given by C\ 
for A — > 0) is too small to give a power-law decay of 
the autocorrelation function. This is seen by considering 
that we can write the autocorrelation function for the 
considered processes as 



R(r) 



7r(r s )e t/Tb dr s 



(11) 



i.e. as the weighted sum of exponentially decaying func- 
tions with characteristic time-scale r s = A -1 and weights 
tt(t s ) — T~ 2 C 2 Ja 2 , where a is the standard deviation of 
the stationary pdf. For power-law correlated processes 
(fi = 2) the weights decay as a power-law proportional to 
l/r{f +1 , whereas for < fi < 2 one has a decay propor- 

4 2-m 

tional to r s 2+,i exp(— 2?7t s 2m ). In the last case the weight 
of the largest time-scales decay too fast to zero to ensure 
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a power-law autocorrelation function. We also observe 
that 

r+oc r+oc 

(r s ) = / tt(t s )t s dr s = / R(t) dr. (12) 
Jo Jo 

Hence the integral of the autocorrelation function is a 
measure of the mean characteristic time of the process. 
This mean characteristic time (t s ) diverges only for the 
class of stochastic processes associated with a quantum 
potential decaying as x~ 2 for |x| — ► oo and with an eigen- 
value spectrum as in case (c) when < (3 < 1. 

Let us finally consider the stochastic process sit) = 
f Q dt'x{t'). It can be considered as the displacement pro- 
cess associated to the velocity process x(t). The mean 
squared displacement (As 2 (t)) is given by 

(As 2 (t))=2[ dt' [ dr (x(t + T)x(t)). (13) 
Jo Jo 

For any stochastic process x(t) with autocorrelation func- 
tion that asymptotically decays proportionally to t - ' 3 
the temporal dependence of the mean squared displace- 
ment (As 2 (t)) for large values of t strongly depends on 
[3. Specifically: (i) when /3 > 1, then (As 2 (t)} ~ D 1 t, 
i.e. sit) is a diffusive stochastic process; (ii) when (3=1 
one has (As 2 (i)) ~ L> 7 t ln(t); (iii) when < (3 < 1 the 
process becomes superdiffusive, i.e. (As 2 (t)) ~ D 1 1 2 ^ 13 . 
The case when the displacement process s(t) is diffusive 
corresponds to an integrable autocorrelation function of 
x(t). Conversely, when R(r) is not integrable the process 
s(t) is not diffusive. The spectral density S(f) of the 
process x(t) is S(f) oc 1// 1_/3 for low frequency values. 
Hence, for values of (3 slightly larger than zero the process 
x(t) is characterized by a 1/ f spectral density at low fre- 



quency. By introducing a long-range correlated station- 
ary Markovian process we have shown that an 1/ /-like 
stochastic process is described by a FP equation with a 
constant diffusion coefficient and with a drift coefficient 
which depends asymptotically on x as —a/x when a is 
slightly larger than 3. One example is the drift D^\x) 
of Eq. (||) , for which the nonlinear Langevin equation is 
xit) = D^-\x) + Tit), where T(t) is a Gaussian white 
noise of zero mean and unit variance. This is an example 
of a nonlinear Langevin equation describing a 1// noise 
which is a stationary, Markovian and non-Gaussian pro- 
cess with finite variance. 

In summary, we show that there exist stationary 
Markovian processes which are characterized by an inter- 
val of time-scales ranging from a finite value to infinite. 
We present analytical evidence that when (i) the range of 
time-scale is infinite and (ii) the mean time-scale (r s ) of 
the process diverges the Markovian process is long-range 
correlated and has associated a low-frequency region of 
the spectral density which may be 1 / /-like. We show 
analytically that both requirements occur for processes 
described by a FP equation with constant diffusion coef- 
ficient which has associated a quantum potential Vs(x) 
asymptotically proportional to x~ 2 and with an eigen- 
value spectrum consisting of a single discrete eigenvalue 
Ao = and an attached continuum part. We also show 
that the divergence of the maximal time-scale of the pro- 
cess is necessary but not sufficient to imply the presence 
of long-range correlation. What is crucial to observe 
long-range correlation is that the mean time-scale (r s ) 
diverges. 
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